SparseSpikformer: A Co-Design Framework for Token and Weight Pruning in Spiking Transformer

As the third-generation neural network, the Spiking Neural Network (SNN) has the advantages of low power consumption and high energy efficiency, making it suitable for implementation on edge devices. More recently, the most advanced SNN, Spikformer, combines the self-attention module from Transformer with SNN to achieve remarkable performance. However, it adopts larger channel dimensions in MLP layers, leading to an increased number of redundant model parameters. To effectively decrease the computational complexity and weight parameters of the model, we explore the Lottery Ticket Hypothesis (LTH) and discover a very sparse ($\ge$90%) subnetwork that achieves comparable performance to the original network. Furthermore, we also design a lightweight token selector module, which can remove unimportant background information from images based on the average spike firing rate of neurons, selecting only essential foreground image tokens to participate in attention calculation. Based on that, we present SparseSpikformer, a co-design framework aimed at achieving sparsity in Spikformer through token and weight pruning techniques. Experimental results demonstrate that our framework can significantly reduce 90% model parameters and cut down Giga Floating-Point Operations (GFLOPs) by 20% while maintaining the accuracy of the original model

Identity-Aware Hand Mesh Estimation and Personalization from RGB Images

Reconstructing 3D hand meshes from monocular RGB images has attracted increasing amount of attention due to its enormous potential applications in the field of AR/VR. Most state-of-the-art methods attempt to tackle this task in an anonymous manner. Specifically, the identity of the subject is ignored even though it is practically available in real applications where the user is unchanged in a continuous recording session. In this paper, we propose an identity-aware hand mesh estimation model, which can incorporate the identity information represented by the intrinsic shape parameters of the subject. We demonstrate the importance of the identity information by comparing the proposed identity-aware model to a baseline which treats subject anonymously. Furthermore, to handle the use case where the test subject is unseen, we propose a novel personalization pipeline to calibrate the intrinsic shape parameters using only a few unlabeled RGB images of the subject. Experiments on two large scale public datasets validate the state-of-the-art performance of our proposed method.Comment: ECCV 2022. Github https://github.com/deyingk/PersonalizedHandMeshEstimatio

Causes of death and conditional survival estimates of long-term lung cancer survivors.

INTRODUCTION: Lung cancer ranks the leading cause of cancer-related death worldwide. This retrospective cohort study was designed to determine time-dependent death hazards of diverse causes and conditional survival of lung cancer. METHODS: We collected 816,436 lung cancer cases during 2000-2015 in the SEER database, after exclusion, 612,100 cases were enrolled for data analyses. Cancer-specific survival, overall survival and dynamic death hazard were assessed in this study. Additionally, based on the FDA approval time of Nivolumab in 2015, we evaluated the effect of immunotherapy on metastatic patients\u27 survival by comparing cases in 2016-2018 (immunotherapy era, n=7135) and those in 2013-2016 (non-immunotherapy era, n=42061). RESULTS: Of the 612,100 patients, 285,705 were women, the mean (SD) age was 68.3 (11.0) years old. 252,558 patients were characterized as lung adenocarcinoma, 133,302 cases were lung squamous cell carcinoma, and only 78,700 cases were small cell lung carcinomas. TNM stage was I in 140,518 cases, II in 38,225 cases, III in 159,095 cases, and IV in 274,262 patients. 164,394 cases underwent surgical intervention. The 5-y overall survival and cancer-specific survival were 54.2% and 73.8%, respectively. The 5-y conditional survival rate of cancer-specific survival is improved in a time-dependent pattern, while conditional overall survival tends to be steady after 5-y follow-up. Except from age, hazard disparities of other risk factors (such as stage and surgery) diminished over time according to the conditional survival curves. After 8 years since diagnosis, mortality hazard from other causes became higher than that from lung cancer. This critical time point was earlier in elder patients while was postponed in patients with advanced stages. Moreover, both cancer-specific survival and overall survival of metastatic patients in immunotherapy era were significantly better than those in non-immunotherapy era (P CONCLUSIONS: Our findings expand on previous studies by demonstrating that non-lung-cancer related death risk becomes more and more predominant over the course of follow-up, and we establish a personalized web-based calculator to determine this critical time point for long-term survivors. We also confirmed the survival benefit of advanced lung cancer patients in immunotherapy era

Mind the numt: Finding informative mitochondrial markers in a giant grasshopper genome

H2020 Marie Sklodowska-Curie Actions, Grant/Award Number: 658706; Ministerio de Ciencia, Innovacion y Universidades, Grant/Award Number: PID2019-104952GB-I00/AEI/10.13039/501100011033The barcoding of the mitochondrial COX1 gene has been instrumental in cataloguing the tree of life, and in providing insights in the phylogeographic history of species. Yet, this strategy has encountered difficulties in major clades characterized by large genomes, which contain a high frequency of nuclear pseudogenes originating from the mitochondrial genome (numts). Here, we use the meadow grasshopper (Chorthippus parallelus), which possesses a giant genome of ~13 Gb, to identify mitochondrial genes that are underrepresented as numts, and test their use as informative phylogeographic markers. We recover the same full mitochondrial sequence using both whole genome and transcriptome sequencing, including functional protein‐coding genes and tRNAs. We show that a region of the mitogenome containing the COX1 gene, typically used in DNA barcoding, has disproportionally higher diversity and coverage than the rest of the mitogenome, consistent with multiple insertions of that region into the nuclear genome. By designing new markers in regions of less elevated diversity and coverage, we identify two mitochondrial genes that are less likely to be duplicated as numts. We show that, while these markers show high levels of incomplete lineage sorting between subspecies, as expected for mitochondrial genes, genetic variation reflects their phylogeographic history accurately. These findings allow us to identify useful mitochondrial markers for future studies in C. parallelus, an important biological system for evolutionary biology. More generally, this study exemplifies how non‐PCR‐based methods using next‐generation sequencing can be used to avoid numts in species characterized by large genomes, which have remained challenging to study in taxonomy and evolution.H2020 Marie Sklodowska-Curie Actions 658706Ministerio de Ciencia, Innovacion y Universidades PID2019-104952GB-I00/AEI/10.13039/50110001103

Historical isolation facilitates species radiation by sexual selection: Insights from Chorthippus grasshoppers

Theoretical and empirical studies have shown that species radiations are facilitated when a trait under divergent natural selection is also involved in sexual selection. It is yet unclear how quick and effective radiations are where assortative mating is unrelated to the ecological environment and primarily results from sexual selection. We address this question using sympatric grasshopper species of the genus Chorthippus, which have evolved strong behavioural isolation while lacking noticeable ecomorphological divergence. Mitochondrial genomes suggest that the radiation is relatively recent, dating to the mid‐Pleistocene, which leads to extensive incomplete lineage sorting throughout the mitochondrial and nuclear genomes. Nuclear data shows that hybrids are absent in sympatric localities but that all species have experienced gene flow, confirming that reproductive isolation is strong but remains incomplete. Demographic modelling is most consistent with a long period of geographic isolation, followed by secondary contact and extensive introgression. Such initial periods of geographic isolation might facilitate the association between male signaling and female preference, permitting the coexistence of sympatric species that are genetically, morphologically, and ecologically similar, but otherwise behave mostly as good biological species